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The invention relates to a method of generating a depth map comprising depth 
values representing distances to a viewer, for respective pixels of an image. 

The invention further relates to a depth map generating unit for generating a 
depth map comprising depth values representing distances to a viewer, for respective pixels 
5 of an image. 

The invention further relates to an image processing apparatus comprising: 
receiving means for receiving a signal corresponding to an image; and 
such a depth map generating unit for generating a depth map. 
The invention further relates to a computer program product to be loaded by a 
10 computer arrangement, comprising instructions to generate a depth map comprising depth 

values representing distances to a viewer, for respective pixels of an image, the computer 

arrangement comprising processing means and a memory. 

15 In order to generate a 3D impression on a multi-view display device, images 

from different virtual view points have to be rendered. This requires either multiple input 
views or some 3D or depth information to be present. This depth information can be either 
recorded, generated from multiview camera systems or generated from conventional 2D 
video material. For generating depth information from 2D video several types of depth cues 

20 can be applied: such as structure from motion, focus information, geometric shapes and 
dynamic occlusion. The aim is to generate a dense depth map, i.e. per pixel a depth value. 
This depth map is subsequently used in rendering a multi-view image to give the viewer a 
depth impression. In the article "Synthesis of multi viewpoint images at non-intermediate 
positions" by P. A. Redert, E.A. Hendriks, and J. Biemond, in Proceedings of International 

25 Conference on Acoustics, Speech, and Signal Processing, Vol. IV, ISBN 0-8186-7919-0, 
pages 2749-2752, IEEE Computer Society, Los Alamitos, California, 1997 a method of 
extracting depth information and of rendering a multi-view image on basis of the input image 
and the depth map are disclosed. 
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It is an object of the invention to provide a method of the kind described in the 
opening paragraph, which is based on a new depth cue. 

This object of the invention is achieved in that the method comprises: 
5 - computing a cost value for a first one of the pixels of the image by combining 

differences between values of pixels which are disposed on a path from the first one of the 
pixels to a second one of the pixels which belongs to a predetermined subset of the pixels of 
the image; and 

assigning a first one of the depth values corresponding to the first one of the 

10 pixels on basis of the cost value. 

The invention is based on the following observation. Objects in a scene to be 
imaged have different sizes, luminances, colors and have a certain spatial disposition. Some 
of the objects occlude other objects in the image. Differences between luminance and/or 
color values of pixels in an image are primarily related to the differences between optical 

15 characteristics of the surfaces of the objects and related to the spatial positions of objects 
relative to light sources within the scene. Optical characteristics of surfaces comprise e.g. 
color and reflectiveness. Hence, a relatively large transition in luminance and/or color, i.e. a 
relatively big difference between pixel values of neighboring pixels corresponds to a 
transition between a first image segment and a second image segment, whereby the first 

20 image segment corresponds to a first object and the second image segment corresponds to a 
second object in the scene being imaged. By deteimining for the pixels of the image the 
number of and extend of transitions in luminance and/or color, i.e. differences between pixel 
values on a path from the respective pixels to a predetermined location of the image, 
respective measures related to the spatial disposition of the objects in the scene can be 

25 achieved. These measures, i.e. cost values are subsequently translated into depth values. This 
translation is preferably a multiplication of the cost value with a predetermined constant. 
Alternatively, this translation corresponds to a mapping of the respective cost values to a 
predetermined range of depth values by means of a normalization. 

It should be noted that the background also forms one or more objects, e.g. the 

30 sky or a forest or a meadow. 

The depth value which is based on the luminance and/or color transients can 
be directly used as depth value for rendering a multi-view image, e.g. as described in the 
cited article. Preferably, the depth value according to the invention is combined with other 
depth values which are based on alternative depth cues as mentioned above. 
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In an embodiment of the method according to the invention, a first one of the 
differences is equal to a difference between respective values of neighboring pixels which are 
disposed on the path. Computing a difference between two adjacent pixels is relatively easy. 
Alternatively, a difference is based on more than two pixel values. In a further alternative, a 
difference is computed between two pixels which are both on the path but which are not 
adjacent, e.g. the difference is computed between a minimu m and a maximum pixel value 
whereby the minimu m and maximum pixel value corresponds to respective pixels which are 
located within a predetermined distance. Preferrably, an absolute difference between 
respective values of pixels which are disposed on the path, is computed. 

In an embodiment of the method according to the invention, the cost value for 
the first one of the pixels is computed by accumulating Ihe differences between the values of 
the pixels which are disposed on the path. Accumulation, i.e. integration, summation or 
addition of differences is relatively easy to implement. Preferably, only the differences which 
are larger than a predetermined threshold are combined by means of accumulation. An 
advantage of applying a threshold is that the depth value determination is less sensitive to 
noise within the image. 

In another embodiment of the method according to the invention, the cost 
value for the first one of pixels is computed by accumulating products of differences between 
the values of the pixels which are disposed on the path and respective weighting fectors for 
the differences. By applying weighting factors, it is possible to control the contributions of 
pixel value differences for the computation of depth values corresponding to the respective 
pixels. For example, a first one of the weighting fectors which is related to a difference 
between a value of a particular pixel and a value of its neighboring pixel, is based on a 
distance between the particular pixel and the first one of the pixels. The first one of the 
weighting fectors is typically relatively low if the distance between the particular pixel and 
the first one of the pixels is relatively high. For example, a second one of the weighting 
factors which is related to a difference between a value of a particular pixel and a value of its 
neighboring pixel, is based on the location of the neighboring pixel related to the particular 
pixel. E.g. the second one of the weighting factors relatively high if the neighboring pixel is 
located above the particular pixel and is relatively low if the neighboring pixel is located 
below the particular pixel. Alternatively, the second one of the weighting factors is related to 
the angle between a first vector and a second vector, whereby the first vector corresponds to 
the location of me neighboring pixel related to the particular pixel and the second vector 
corresponds to the location of the first one of pixels related to the second one of the pixels. 
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An embodiment according to the invention, further comprises: 
computing a second cost value for the first one of the pixels of the image by 
combining differences between values of pixels which are disposed on a second path from 
the first one of the pixels to a third one of the pixels which belongs to the predetermined 
subset of the pixels of the image; 

determining the minimum of the cost value and the second cost value; 
assigning the first one of the depth values corresponding to the first one of the 
pixels on basis of the minimum. 

In this embodiment according to the invention, the first one of depth values is 
based on a particular selection of multiple values related to multiple paths, i.e. the optimum 
path from the first one of the pixels to the second one of the pixels. An alternative type of 
selection or combination of the cost values related to respective paths is advantageous. For 
instance an average of cost values related to multiple paths can be computed. 

It is a further object of the invention to provide a depth map generating unit of 
the kind described in the opening paragraph, which is based on a new depth cue. 

This object of the invention is achieved in that the generating unit comprises: 
computing means for computing a cost value for a first one of the pixels of the 
image by combining differences between values of pixels which are disposed on a path from 
the first one of the pixels to a second one of the pixels which belongs to a predetermined 
subset of the pixels of the image; and- 

assigning means for assigning a first one of the depth values corresponding to 
the first one of the pixels on basis of the cost value. 

It is a further object of the invention to provide an image processing apparatus 
comprising a depth map generating unit of the kind described in the opening paragraph which 
is arranged to generate a depth map based on a new depth cue. 

This object of the invention is achieved in that the generating unit comprises: 
computing means for computing a cost value for a first one of the pixels of the 
image by combining differences between values of pixels which are disposed on a path from 
the first one of the pixels to a second one of the pixels which belongs to a predetermined 
subset of the pixels of the image; and- 

assigning means for assigning a first one of the depth values corresponding to 
the first one of the pixels on basis of the cost value. 

It is a further object of the invention to provide a computer program product of 
the kind described in the opening paragraph, which is based on a new depth cue. 
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This object of the invention is achieved in that the computer program product, 
after being loaded, provides said processing means with the capability to carry out: 

computing a cost value for a first one of the pixels of the image by combining 
differences between values of pixels which are disposed on a path from the first one of the 
5 pixels to a second one of the pixels which belongs to a predetennined subset of the pixels of 
the image; and 

assigning a first one of the depth values corresponding to the first one of the 
pixels on basis of the cost value. 

Modifications of the depth map generating unit and variations thereof may 
10 correspond to modifications and variations thereof of the image processing apparatus, the 
method and the computer program product, being described. 

These and other aspects of the depth map generating unit, of the image 
15 processing apparatus, of the method and of the computer program product, according to the 
invention will become apparent from and will be elucidated with respect to the 
implementations and embodiments described hereinafter and with reference to the 
accompanying drawings, wherein: 

Fig. 1 schematically shows an image and the corresponding depth map being 
20 generated with the method according to the invention; 

Fig. 2 schematically shows two paths; 

Fig. 3 schematically shows a path from a first pixel to a second pixel, a first 
vector from the first pixel to the second pixel and a second vector from a third pixel to a 
fourth pixel on the path; 

25 Fig. 4 schematically shows a multi-view image generation unit comprising a 

depth map generation unit according to the invention; and 

Fig. 5 schematically shows an embodiment of the image processing apparatus 
according to the invention. 

Same reference numerals are used to denote similar parts throughout the 

30 figures. 



Fig. 1 schematically shows an image 100 and the corresponding depth map 
122 being generated with the method according to the invention. Fig. 1 shows an image 100 
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representing a first object 106, a second object 104 which is located behind the first object 
106 and a third object 102 which is located behind the second object 104. Fig. 1 further 
shows a path 1 12 from a first pixel 108 to a second pixel 110. The path 1 12 corresponds to a 
group of connected pixels. 
5 In general, a pixel in an image is connected to 8 neighboring pixels, i.e. 2 

pixels being horizontally located relative to the pixel, 2 pixels being vertically located 
relative to the pixel and 4 pixels being diagonally located relative to the pixel. Pairs of pixels 
of the path 1 12 are mutually located in one of these 3 ways, i.e. horizontally, vertically or 
diagonally relative to each other. 

10 In Fig. 1 two pairs of pixels, comprising the pixels with respective reference 

numbers 114, 116 and 118, 120 are depicted. The first pair of pixels 114, 116 is disposed on 
the path 1 12 on a location corresponding to the transition between the first object 106 to the 
second object 104. The second pair of pixels 1 18, 120 is disposed on the path 1 12 on another 
location corresponding to the transition between the second object 104 and the first object 

15 102. 

Fig. 1 also shows a depth map 122. The depth map 122 comprises a first group 
128 of depth values corresponding to the first object 106, comprises a second group 126 of 
depth values corresponding to the second object 104 and comprises a third group 124 of 
depth values corresponding to the third object 102. The depth values of the first group 128 of 
20 depth values are lower than the depth values of the second group 126 of depth values, 

meaning that the first object 106 is more close to a viewer of the image 100 or to a multi- 
view image which is based on the image 100, than the second object 104. 

The depth map 122 is generated on basis of the method according to the 
invention. For the generation of the depth value 130 corresponding to the first pixel 108 the 
25 following steps are performed: 

a cost value for the first pixel 108 of the image is computed by combining 
differences between values of pairs of connected pixels 1 14, 1 16 and 118, 120, which are 
disposed on a path 1 12 from the first pixel 1 08 to the second pixel 110 which belongs to a 
predetermined subset of the pixels of the image 100; and 
30 - the depth value 130 corresponding to the first pixel 108 is computed by 

dividing a constant value by the cost value for the first pixel 108. 

The second pixel 110 belongs to a predetermined subset of the pixels of the 
image 100. In this case the predetermined subset comprises pixels at the border of the image. 
In alternative embodiments the subset comprises pixels of a part of the border, e.g. only the 
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pixels of the upper border of the image or the lower border of the image. In a further 
alternative the subset comprises a central pixel of the image. 

As explained above, the assigned depth value for the first pixel 108 is related 
to a cost function for the first pixel 108. The cost function is based on transitions, i.e. the cost 
5 value increases when there are more and/or bigger transitions on the path from the first 108 
pixel to the second pixel 110. The assigned depth value can be based on one of the following 
approaches: 

the first pixel is assigned a relatively low depth value if the corresponding cost 
value is relatively low; or 
1 0 the first pixel is assigned a relatively high depth value if the corresponding 

cost value is relatively high. 

To summarize, there is a relation between the cost value and the location of 
the second pixel 110 and a relation between the assigned depth value and the cost value. 
Table 1 shows a number of possible relations between these quantities. In the cases as listed 
15 in Table 1 , it is assumed that the first pixel 1 08 is located at the center of image. 



Table 1 Relations between location, cost value and depth value. 



Location of the second pixel 


Cost value of the first pixel 


Depth value of the first pixel 


Upper border 


High 


High 


Upper border 


High 


Low 


Lower border 


High 


High 


Lower border 


High 


Low 


Left/right border 


High 


High 


Left/right border 


High 


Low 


Center 


Low 


High 


Center 


Low 


Low 



A relatively low depth value means that the first pixel is relatively close to the 
20 viewer of the multi view image being generated on basis of the image and a relatively high 
depth value means that the first pixel is relatively fer removed from the viewer of the multi 
view image. 

Preferably, the computation of the cost value V(x\ y) is based on an 
accumulation of pixel value differences which are allocated to pixels being located on a path 
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p. from the first pixel to the second pixel, with i being an index to indicate a particular one of 
the paths from the pixel with coordinates (x\y) . 

V{x\y) = P,} (1) 

A first example of the computation of a pixel value difference E(x, y) is given 

5 in Equation 2: 

E(x,y) =| I(x,y) -I(x-a,y-b)\ (2) 

with, I(x,y) the luminance value of a pixel with coordinates x and y of the image and 

-l<a<l and -1<6<1. 

Alternatively, a pixel value difference E(x,y) is computed on basis of color 

10 values: 

E(x 9 y) =| C(x,y) -C(x-a,y-b)\ (3) 
with, C(x 9 y) a color value of a pixel with coordinates x and y of the image. In Equation 4 a 
further alternative is given for the computation of a pixel value difference E(x,y) based on 
the three different color components R (Red) G (Green) and B (Blue). 

15 E{x 9 y) = max(| R(x, y) -R(x-a,y- b) |,| G(x 9 y) -G(x-a,y- b) |,| B(x, y) -B{x~a,y- b) |) 

(4) 

Optionally, the pixel value difference signal E is filtered by clipping all pixel 
value differences which are below a predetermined threshold, to a constant e.g. zero. 

As said, preferably the computation of the cost value V(x\y') is based on an 
20 accumulation of pixel value differences being allocated to pixels being located on a path 

P. from the first pixel to the second pixel. There are several approaches to select this path P. 

from a set of paths. 

Fig. 1 schematically shows a path which is based on a simple strategy, i.e. the 
shortest distance from the first pixel 108 to a pixel of the predetermined set being the pixels 
25 which are located at the left border of the image. That means that the first pixel 108 and the 
second pixel 1 10 have the same y-coordinate. 

Fig. 2 schematically shows alternative paths 216, 202. The first one 216 of 
these alternative paths corresponds to the shortest distance from the first pixel 108 to a 
second pixel 214 of the predetermined set being the pixels which are located at the left border 
30 of the image. In this case the restriction that the first pixel 108 and the second pixel 214 have 
mutually equal y-coordinates is not applicable. The second pixel 214 corresponds to the pixel 
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of left border pixels which can be reached with minimum costs. On the first one 216 of these 
alternative paths the pixels with the following reference numbers 218-224 are disposed. 

Fig. 2 also shows a second one 202 of alternative paths, which corresponds to 
the path reaching the upper border and having minimum costs. It can be clearly seen that the 
5 second one 202 of alternative paths has an irregular shape. On the second one 202 of 
alternative paths the pixels with the following reference numbers 206-212 are disposed. 

Instead of computing the cost value V(x\y') on basis of a single path, the cost 
value can be based on a combination of paths, e.g. the average cost values is computed. 

A further alternative for computing the cost value V(x\y') is based on 
10 weighting factors for the various pixel value differences. 

V(x\f) = Y,{W(j)E(.x,y)\(x, y )<z Ft} (5) 
This weighting factor W(j) is preferably related to a spatial distance j 
between one of the pixels of the pixel pair for which a pixel value difference E(x 9 y) is being 
computed and the first pixel. Typically, this weighting factor W(j) is lower for bigger spatial 
15 distances. 

Alternatively, the weighting factor W(j) is related to an angle between two 
vectors. Fig. 3 schematically shows a path from a first pixel 108 to a second pixel 1 10, a first 
vector 308 from the first pixel 108 to the second pixel 110 and a second vector 306 from a 
third pixel 302 to a fourth pixel 304 on the path 300. Typically, the weighting factor W(J) is 

20 relatively high if the angle between the first vector 308 and the second vector 306 is 
relatively low, i.e. the orientation of the fourth pixel 304 relative to the third pixel 302 
matches with the orientation of the second pixel 1 10 relative to the first pixel 108. That 
means that transitions which match with the first vector 308 are considered to be more 
relevant than transitions which are e.g. perpendicular to the first vector 308. 

25 Fig 4 schematically shows a multi-view image generation unit 400 comprising 

a depth map generation unit 401 according to the invention. The multi-view image generation 
unit 400 is arranged to generate a sequence of multi-view images on basis of a sequence of 
video images. The multi-view image generation unit 400 is provided with a stream of video 
images at the input connector 408 and provides two correlated streams of video images at the 

30 output connectors 410 and 412, respectively. These two correlated streams of video images 
are to be provided to a multi-view display device which is arranged to visualize a first series 
of views on basis of the first one of the correlated streams of video images and to visualize a 
second series of views on basis of the second one of the correlated streams of video images. 
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If a user, i.e. viewer, observes the first series of views by his left eye and the 
second series of views by his right eye he notices a 3D impression. It might be that the first 
one of the correlated streams of video images corresponds to the sequence of video images as 
received and that the second one of the correlated streams of video images is rendered on 
5 basis of the sequence of video images as received. Preferably, both streams of video images 
are rendered on basis of the sequence of video images image as received. The rendering is 
e.g. as described in the article "Synthesis of multi viewpoint images at non-intermediate 
positions" by P. A. Redert, E.A. Hendriks, and J. Biemond, in Proceedings of International 
Conference on Acoustics, Speech, and Signal Processing, Vol. IV, ISBN 0-8186-7919-0, 
10 pages 2749-2752, IEEE Computer Society, Los Alamitos, California, 1997. Alternatively, the 
rendering is as described in "High-quality images from 2.5D video", by R.P. Berretty and 
F.E. Ernst, in Proceedings Eurographics, Granada, 2003, Short Note 124. 

The multi-view image generation unit 400 comprises: 

a depth map generation unit 401 for generating depth maps for the respective 
15 input images on basis of the transitions in the image; and 

a rendering unit 406 for rendering the multi-view images on basis of the input 
images and the respective depth maps, which are provided by the depth map generation unit 
401. 

The depth map generating unit 401 for generating depth maps comprising 
20 depth values representing distances to a viewer, for respective pixels of the images, 
comprises: 

a cost value computing unit 402 for computing a cost value for a first one of 
the pixels of the image by combining differences between values of pixels which are 
disposed on a path from the first one of the pixels to a second one of the pixels which belongs 
25 to a predetermined subset of the pixels of the image. The computation of cost values is as 
described in connection with any of the Figs. 1,2 and 3; and 

a depth value assigning unit 404 for assigning a first one of the depth values 
corresponding to the first one of the pixels on basis of the cost value. 

The computing unit 402 is arranged to provide a cost value signal 
30 V F = V(x\y\ri) , with coordinates x f and / of image at time n , which represents per pixel 
the cost value. 

After the computation of the cost value signal V F the depth map is determined. 
This is specified in Equation 6: 
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D(x' 9 y,n) = F<y F ) (6) 
with D(x\y\n) the depth value of a pixel with coordinates x r and y 1 of image at time n and 
the function F(J) being a linear or non-linear transformation of a cost value V(x\y\ri) , into 
a depth value D(x\y\ri) . This function F(j) is preferably a simple multiplication of the 
5 cost value V(x\y\ri) with a predetermined constant: 

D(x\y\n) = oc V(x\y\n) (7) 
It should be noted that for the computation of the cost value for a particular 
pixel the computed cost value for a neighboring pixel can be applied. In other words, the 
computation of cost values is preferably performed in a recursive way. 
10 The cost value computing unit 402, the depth value assigning unit 404 and the 

rendering unit 406 may be implemented using one processor. Normally, these functions are 
performed under control of a software program product. During execution, normally the 
software program product is loaded into a memory, like a RAM, and executed from there. 
The program may be loaded from a background memory, like a ROM, hard disk, or 
15 magnetically and/or optical storage, or may be loaded via a network like Internet. Optionally 
an application specific integrated circuit provides the disclosed functionality. 

It should be noted that, although the multi-view image generation unit 400 as 
described in connection with Fig. 4 is designed to deal with video images, alternative 
embodiments of the depth map generation unit according to the invention are arranged to 
20 generate depth maps on basis of individual images, i.e. still pictures. 

Fig. 5 schematically shows an embodiment of the image processing apparatus 
500 according to the invention, comprising: 

receiving unit 502 for receiving a video signal representing input images; 
a multi-view image generation unit 401 for generating multi-view images on 
25 basis of the received input images, as described in connection with Fig 4; and 

a multi-view display device 506 for displaying the multi-view images as 
provided by the multi-view image generation unit 401. 

The video signal maybe a broadcast signal received via an antenna or cable 
but may also be a signal from a storage device like a VCR (Video Cassette Recorder) or 
30 Digital Versatile Disk (DVD). The signal is provided at the input connector 510. The image 
processing apparatus 500 might e.g. be a TV. Alternatively the image processing apparatus 
500 does not comprise the optional display device but provides the output images to an 
apparatus that does comprise a display device 506. Then the image processing apparatus 500 
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might be e.g. a set top box, a satellite-tuner, a VCR player, a DVD player or recorder. 
Optionally the image processing apparatus 500 comprises storage means, like a hard-disk or 
means for storage on removable media, e.g. optical disks. The image processing apparatus 
500 might also be a system being applied by a film-studio or broadcaster. 
5 It should be noted that the above-mentioned embodiments illustrate rather than 

limit the invention and that those skilled in the art will be able to design alternative 
embodiments without departing from the scope of the appended claims, hi the claims, any 
reference signs placed between parentheses shall not be constructed as limiting the claim. 
The word 'comprising' does not exclude the presence of elements or steps not listed in a 

10 claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements. The invention can be implemented by means of hardware 
comprising several distinct elements and by means of a suitable programmed computer. In 
the unit claims enumerating several means, several of these means can be embodied by one 
and the same item of hardware. The usage of the words first, second and third, etcetera do not 

15 indicate any ordering. These words are to be interpreted as names. 
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CLAIMS: 



1 - A method of generating a depth map (122) comprising depth values 

representing distances to a viewer, for respective pixels of an image (100), the method 
comprising: 

computing a cost value for a first one of the pixels (108) of the image by 
5 combining differences between values of pixels which are disposed on a path (112) from the 
first one of the pixels (108) to a second one of the pixels (1 10) which belongs to a 
predetermined subset of the pixels of the image; and 

assigning a first one of the depth values corresponding to the first one of the 
pixels (108) on basis of the cost value. 

10 

2. A method as claimed in Claim 1, whereby the predetermined subset comprises 
pixels which are located at a border of the image. 

3. A method as claimed in Claim 1, whereby a first one of the differences is 

15 equal to a difference between respective values of neighboring pixels which are disposed on 
the path (112). 

4. A method as claimed in Claim 1, whereby a second one of the differences is 
equal to an absolute difference between respective values of neighboring pixels which are 

20 disposed on the path (1 12). 

5. A method as claimed in Claim 1, whereby the values of pixels corresponds to 
one of luminance and color. 

25 6. A method as claimed in Claim 1, whereby the cost value for the first one of the 

pixels (108) is computed by accumulating the differences between the values of the pixels 
which are disposed on the path (1 12). 
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7. A method as claimed in Claim 1 , whereby the cost value for the first one of the 
pixels (108) is computed by accumulating the differences between the values of the pixels 
which are disposed on the path (1 12), the differences being larger than a predetermined 
threshold. 

5 

8. A method as claimed in Claim 1 , whereby the cost value for the first one of 
pixels is computed by accumulating products of differences between the values of the pixels 
which are disposed on the path (1 12) and respective weighting factors for the differences. 

10 9. A method as claimed in Claim 8, whereby a first one of the weighting factors 

which is related to a difference between a value of a particular pixel and a value of its 
neighboring pixel, is based on a distance between the particular pixel and the first one of the 
pixels (108). 

15 10. A method as claimed in Claim 8, whereby a second one of the weighting 

factors which is related to a difference between a value of a particular pixel and a value of its 
neighboring pixel, is based on the location of the neighboring pixel related to the particular 
pixel. 

20 1 1 . A method as claimed in Claim 1 , which further comprises: 

computing a second cost value for the first one of the pixels (108) of the image 
by combining differences between values of pixels which are disposed on a second path 
(202) from the first one of the pixels (108) to a third one of the pixels (204) which belongs to 
the predetermined subset of the pixels of the image; 
25 - determining the minimum of the cost value and the second cost value; 

assigning the first one of the depth values corresponding to the first one of the 
pixels (108) on basis of the minimum. 

12. A depth map generating unit (401) for generating a depth map (122) 

30 comprising depth values representing distances to a viewer, for respective pixels of an image 
(100), the generating unit comprising: 

computing means for computing a cost value for a first one of the pixels (1 08) 
of the image by combining differences between values of pixels which are disposed on a path 
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(1 12) from the first one of the pixels (108) to a second one of the pixels (1 1 0) which belongs 
to a predetermined subset of the pixels of the image; and 

assigning means for assigning a first one of the depth values corresponding to 
the first one of the pixels (108) on basis of the cost value. 

5 

13 . An image processing apparatus (500) comprising: 

receiving means (502) for receiving a signal corresponding to an image (100); 

and 

a depth map generating unit (401) for generating a depth map (122), as 
1 0 claimed in Claim 1 . 



14. A computer program product to be loaded by a computer arrangement, 

comprising instructions to generate a depth map (122) comprising depth values representing 
distances to a viewer, for respective pixels of an image (100), the computer arrangement 

15 comprising processing means and a memory, the computer program product, after being 
loaded, providing said processing means with the capability to carry out: 

computing a cost value for a first one of the pixels (108) of the image by 
combining differences between values of pixels which are disposed on a path (1 12) from the 
first one of the pixels (108) to a second one of the pixels (1 10) which belongs to a 

20 predetermined subset of the pixels of the image; and 

assigning a first one of the depth values corresponding to the first one of the 
pixels (108) on basis of the cost value. 
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ABSTRACT: 



A method of generating a depth map (122) comprising depth values 
representing distances to a viewer, for respective pixels of an image (100), is disclosed. The 
method comprises: computing a cost value for a first one of the pixels (108) of the image hy 
combining differences between values of pixels which are disposed on a path (112) from the 
first one of the pixels (108) to a second one of the pixels (1 10) which belongs to a 
predetermined subset of the pixels of the image; and assigning a first one of the depth values 
corresponding to the first one of the pixels (108) on basis of the cost value. 



Fig. 1 
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